Method and System for Optoelectronic Detection and Location of Objects

ABSTRACT

Disclosed are methods and systems for optoelectronic detection and location of moving objects. The disclosed methods and systems capture one-dimensional images of a field of view through which objects may be moving, make measurements in those images, select from among those measurements those that are likely to correspond to objects in the field of view, make decisions responsive to various characteristics of the objects, and produce signals that indicate those decisions. The disclosed methods and systems provide excellent object discrimination, electronic setting of a reference point, no latency, high repeatability, and other advantages that will be apparent to one of ordinary skill in the art.

FIELD OF THE INVENTION

The invention relates to optoelectronic sensors for detecting objectsand providing information describing the objects, particularly theirlocation.

BACKGROUND OF THE INVENTION

Optoelectronic sensors for detecting and locating objects are valuablein a wide variety of fields; one example is industrial automation. Inorder to understand the operation, capabilities, and limitations of suchsensors, consider a specific example application—printing alphanumericcharacters on labels in a high-speed production bottling line. In atypical such application, a sensor detects the presence of a bottle at apredetermined point as it moves down the production line, and produces asignal that tells a printer to start printing when a bottle is locatedat that point.

If a signal is produced when a bottle is at the proper location, desiredalphanumeric characters are printed on the bottle's label in a desiredlocation. If a bottle is not detected, however, its label will not beprinted, a potentially costly mistake. If a signal is produced when nobottle is present, the printer may spray ink into the air, which mayhave adverse effects on the production process. If a signal is producedwhen a bottle is present but not in the proper location, the characterswill be printed in the wrong location on the label.

From this example it can see seen that an optoelectronic sensor fordetecting and locating objects should detect only the desired objects,and only in the desired location.

Photoelectric sensors, which comprise a type of optoelectronic sensor,have long been used to detect and locate objects. Such sensors typicallyoperate by emitting a beam of light and detecting light received. Theycome in a variety of configurations suitable for a variety ofapplications, including the following:

In one configuration an emitter and a receiver are placed at oppositeends of a path, so that anything crossing the path that is nottransparent breaks the beam of light; an object is detected when thereceiver sees very little light. The placement of the emitter andreceiver determines the path and thereby the location at which an objectis detected. The application is constrained to insure that only desiredobjects cross the path, and so that determining the location of an edgeof the object is all that is needed. In the bottling application, forexample, this would mean that the label is in a fixed position relativeto the edge of the bottle.

In a second configuration an emitter and receiver are placed in onelocation, with a retro-reflector placed at the opposite end of a paththat reflects the beam from the emitter back to the receiver. Thisconfiguration is similar to the previous, but is more convenient toinstall because all of the required wiring is done at only one end ofthe path instead of at both ends. However, if the objects to be detectedare reflective, misdetection and/or mislocation errors may occur.

In a third configuration an emitter and receiver are placed in onelocation, and the emitter emits a focused beam of light so that anythingsufficiently reflective crossing in front of the beam reflects it backto the receiver. An object is detected when the receiver sees an amountof light above some predefined threshold. The placement of theemitter/receiver assembly determines the location of the beam andthereby the location at which an object is detected. The use of afocused beam makes this location relatively precise, and reduces thechances of misdetecting objects in the background because the beam willbe out of focus. The objects and their environment are constrained sothat the reflected light exceeds the threshold only when desired objectsare in the desired location.

A fourth configuration is a variation of the third wherein a diffusebeam of light is used instead of a focused beam. This makes it easier todetect objects whose positions are not well constrained, but decreasesthe precision of the location at which objects are detected andincreases the chances that a detection will occur when no desired objectis in front of the beam.

Photoelectric sensors of these types include those manufactured and soldby Banner Engineering Corp., of Minneapolis, Minn., for example theirMINI-BEAM® line.

Photoelectric sensors typically provide a simple signal to indicate thatan object has been detected, and to indicate its location. Such a signalhas two states, which might be called “present” and “absent”. In thefirst and second configuration, for example, the signal would be in the“present” state when little light is detected by the receiver; in thirdor fourth configuration, the signal would be in the “present” state whenlight above a threshold is detected by the receiver.

An object is detected when the signal is in the “present” state. Amoving object is located by the time of a transition from “absent” to“present” on the signal—the object is located in a known, predeterminedposition, called herein a reference point, at the time of thetransition. For any of the four photoelectric sensor configurationsdescribed above, the reference point is determined by the position ofthe beam and is adjusted by physically moving the sensor. Note that asused herein the reference point refers to the desired location of theobject; the actual location of the object at the signal time may differfor various reasons as described herein.

Usually a photoelectric sensor is used to detect specific objects andlocate them at a specific position, for example to detect bottles movingdown a conveyer belt and indicate the time at which the leading edge ofsuch a bottle has reached a certain reference point, for example infront of a printer. No sensor is a perfect judge of object presence andlocation, and failures will result if a desired object is not detected,if some other condition, such as an unexpected object or light source,results in a false detection, or if a desired object is detected butmislocated.

In order to increase the reliability of detection and location, aphotoelectric sensor may employ one or more techniques. The differentconfigurations described above, for example, allow different tradeoffsbetween missed objects, false detection, and other factors that can bematched to the needs of a specific application. For example, aretro-reflective configuration is unlikely to miss an object butrequires mounting two elements, the sensor and the reflector, insuitable locations. A focused beam is less likely to detect anunexpected object because it has a narrow range of focus.

A sensitivity adjustment is typically used as another tradeoff betweenmissed objects and false detection for each sensor configuration. In thefocused beam configuration, for example, the sensitivity adjustmentdetermines the predefined detection threshold. Increasing the thresholdmakes false detections less likely but missed objects more likely;decreasing the threshold makes the opposite tradeoff.

In addition, sensors may employ a suitably modulated beam of light sothat stray light is unlikely to cause a misdetection. For example, thebeam can be pulsed on and off at a high frequency, and the receiver isdesigned to only detect light pulsed at that frequency.

A commonly used term of art for photoelectric sensors is backgroundsuppression, which describes various means for ignoring reflections ofthe emitted beam by objects in the background (i.e. beyond somepredetermined distance), so that misdetection can be made less likely.U.S. Pat. No. 5,760,390, for example, describes such a device as well asproviding information on prior art devices.

Photoelectric sensors are well-suited to object detection and location,and are widely used, but they have a variety of limitations.

Such sensors have a very limited ability to distinguish desired objectsfrom other conditions such as unexpected objects, variations in objectreflectivity, confusing markings or features on the objects, and thelike. Generally all the sensor can measure is how much light it'sreceiving. A gray object at 5 centimeters distance, for example, mightreflect as much light back to the receiver as a white object at 10centimeters, even if the beam is somewhat out of focus at 10centimeters. Considerable care must be taken to insure that the presenceof a desired object at a desired location, and no other condition,results in an amount of light received that is above or below apredetermined threshold. This limits the ways in which such sensors canbe installed, the nature of objects to be detected and located, and themanner in which such objects are presented to the sensor, among otherconcerns. Furthermore, generally only edges of objects can be detectedand located; it is difficult and in many cases impractical to detect andlocate markings or other features on the object.

With a photoelectric sensor, establishing or adjusting the referencepoint generally involves physically moving the sensor. Such anadjustment is challenging to make and may have undesirable consequencesif not made carefully. Furthermore, it is difficult to establish areference point with high precision.

Photoelectric sensors have an inherent delay between the time that anobject crosses the reference point and the time that the signaltransition occurs. This delay is commonly called latency or responsetime, and is typically of the order of hundreds of microseconds. Anobject will move away from the reference point during this delay, by adistance that increases as object velocity increases. Furthermore, sincea reference point is usually established at installation time usingstationary objects, the actual location of the object at the signal timewill always be different in production use where the objects are moving.If the latency and velocity are known it may be possible to compensatefor the latency, but doing so adds complexity and cost, and might notalways be practical.

The latency of a photoelectric sensor can generally be reduced by givingup some reliability of detection. The less time the sensor has to make adetection decision, the less reliable the decision will be.

Photoelectric sensors have an inherent uncertainty in the signaltransition time, typically referred to in the art as repeatability, andalso typically of the order of hundreds of microseconds. This translatesto uncertainty in the location of the object at the signal time, wherethe uncertainty is proportional to object velocity.

The combination of physical positioning, latency, and repeatabilitylimit the accuracy of a photoelectric sensor in locating objects.

Recently a new class of optoelectronic sensors have been developed,described in pending U.S. patent application Ser. No. 10/865,155 filedJun. 9, 2004. These sensors, called therein vision detectors, addresssome of the limitations of photoelectric sensors. A vision detector usesa two-dimensional imager (similar to those used in digital cameras)connected to a computer or like device that analyzes the digital imagesto make detection and location decisions.

Vision detectors provide an ability to distinguish desired objects fromother conditions that far surpasses that which can be achieved withphotoelectric sensors. This ability is achieved by using two-dimensionalbrightness patterns to detect and locate objects. Establishing areference point can be done electronically by means of a human-machineinterface. These devices, however, exhibit significant latency, on theorder of several milliseconds, and repeatability that, even underfavorable conditions, is no better than that of photoelectric sensors.

Vision detectors, furthermore, are very expensive compared tophotoelectric sensors, and far more complex to set up for a givenapplication.

SUMMARY OF THE INVENTION

The invention provides optoelectronic methods and systems for detectingmoving objects and providing information describing the objects,including but not limited to the location of the objects. The disclosedmethods and systems provide embodiments offering some or all of thefollowing benefits:

-   -   advanced ability to distinguish desired objects from other        conditions, based on measurements made in one-dimensional        images, including embodiments that use normalized correlation        pattern detection methods and processes;        -   electronic setting and adjustment of a reference point using            a human-machine interface;        -   no latency, or even negative latency, optionally adjustable            using a human-machine interface and based on predicting a            time at which an object will cross a reference point;        -   very high repeatability, based on very high image capture            and analysis rates and precise methods for determining            object position;        -   relatively low cost;        -   relatively easy to set up and test; and        -   other advantages described herein or that will be apparent            to one of ordinary skill in the art.

Objects to be detected and/or located are in motion relative to thefield of view of an optical sensor, which makes light measurements inthat field of view. One-dimensional images oriented approximatelyparallel to the direction of motion are captured and analyzed to produceinformation describing the objects, and the information may be used forany purpose, including communicating to other systems using a signal. Intypical embodiments, the optical sensor is a linear optical sensorcomprising a one-dimensional array of photoreceptors.

As used herein the term downstream means “in the direction of motion”,and the term upstream means “opposite the direction of motion”.

The use of one-dimensional images orientated approximately parallel tothe direction of motion provides significant and unanticipatedadvantages over prior art systems that use emitter/receiverconfigurations, two-dimensional imagers, or one-dimensional images inother orientations. The object motion combined with the imageorientation provide a time-sequence of one-dimensional images of a sliceof an object as it enters, moves within, and/or exits the field of view.The object motion insures that at least a portion of the captured imagescorrespond to a plurality of positions of the object relative to thefield of view. This provides, among other benefits, a plurality ofviewing perspectives, giving far more information about the object thancan be obtained from a single perspective. The use of images obtainedfrom multiple viewpoints contributes to the ability to reliablydistinguish desired objects from other conditions, and to track objectmotion so as to provide highly repeatable location information with nolatency. Embodiments comprising a linear optical sensor and a digitalprocessor powerful enough to handle one-dimensional images are veryinexpensive.

By contrast a prior art emitter/receiver configuration is essentially azero-dimensional sensor that only measures how much light is beingreceived. There is no ability to distinguish desired objects by, forexample, pattern detection methods, and no ability to visually trackobjects passing through a field of view to improve detection reliabilityor provide more accurate location information.

Use of one-dimensional images permits a much higher capture and analysisrate, at lower cost, than prior art systems that use two-dimensionalimages for detection and location. An illustrative vision detectordescribed in pending U.S. patent application Ser. No. 10/865,155, forexample, operates at 500 images per second. An illustrative embodimentof the present invention, described below, operates at over 8000 imagesper second, and at far lower cost. This high operating rate combinedwith the processes described herein allows latency to be eliminated andrepeatability to be dramatically improved. The above-referenced patentapplication does not describe or contemplate that one-dimensional imagesoriented approximately parallel to the direction of motion could be usedfor the purposes described herein, or that latency could be eliminatedby any means.

It has long been known in the prior art to image moving objects usinglinear array sensors oriented approximately perpendicular to thedirection of motion. One purpose of such a configuration is to obtain atwo-dimensional image of an object from a single viewpoint, not atime-sequence of a slice of the object in multiple positions. Such alinear array, oriented approximately perpendicular to the direction ofmotion, is simply an alternative to a two-dimensional camera that hascertain advantages and disadvantages compared to such a camera. It isnot suitable for the purposes described herein. Other uses of lineararray sensors oriented approximately perpendicular to the direction ofmotion are known, but likewise are not suitable for the purposesdescribed herein.

The methods and systems herein disclosed capture one-dimensional imagesof a field of view through which objects may be moving, and analyze atleast a portion of the images to provide information describing theobjects.

In some embodiments, the information describing the object comprisesknowledge responsive to object presence in the field of view, forexample knowledge that an object is in the field of view or crosses areference point.

In some embodiments, the information describing the object comprises anestimate of a time at which the object crosses a reference point, calledherein a reference time. These embodiments allow the object to belocated—the object is located at the reference point at the referencetime, an estimate of which is provided by the information describing theobject.

Some embodiments provide an electronic human-machine interface thatallows the reference point to be adjusted, for example by providingpushbuttons to move the reference point upstream or downstream. Thisallows the reference point to be set very precisely, and withoutphysically moving the sensor.

Some embodiments provide a signal that serves to locate the object byindicating the estimate of the reference time. The indication can bemade in a variety of ways well-known in the art, and further describedbelow; in some embodiments the signal indicates the estimated timesimply by occurring at that time, or responsive to that time, forexample delayed or advanced by some amount. In such embodiments the timethat the signal occurs is referred to herein as a signal time. Ahuman-machine interface can also be provided to allow adjustment of thesignal time relative to the estimated time.

In some embodiments, there is no latency between the actual referencetime and the signal time. In some embodiments, the estimate of thereference time is determined by predicting the reference time.

Some embodiments provide an example object and a setup signal forsetting the reference point. The example object is placed at the desiredreference point, and the setup signal indicates that it is so placed. Inresponse to the setup signal, one or more images of the field of viewcontaining the example object are captured and analyzed to set thereference point. This allows the sensor to be installed in anapproximate location, and then have the reference point set preciselywithout physically moving the sensor. The setup signal can come from ahuman-machine interface, from other equipment, from software subroutinecalls, or from any means known in the art. In such embodiments, a signalcan be produced at a time when the object crosses the reference point(no latency), is upstream from the reference point (negative latency),or is downstream from the reference point (positive latency).

Some embodiments employ a test object and a human-machine interface thatpermit an installation of the sensor to be tested. Suitable indictorstell if the test object is detected in the field of view, and if sowhether it is upstream or downstream from the reference point.

In some embodiments, the methods and systems make measurements in atleast a plurality of the captured images, select from those measurementsthose judged responsive to an object in the field of view, use theselected measurements to make decisions that produce informationdescribing an object, and optionally produce signals that communicatethat information.

In such embodiments, image measurements are made for captured images,where the image measurements comprise any suitable computation on theimage. Examples of image measurements include brightness, contrast, edgequality, peak correlation value, peak correlation position, and manyothers well-known in the art.

A set of object measurements are selected from among the imagemeasurements, wherein the object measurements comprise imagemeasurements that are judged responsive to an object in the field ofview. Some or all of the image measurements are used to select theobject measurements, so that the judgment is made not blindly but basedon conditions in the field of view. An image measurement particularlysuited to such a judgment is peak correlation value using a modelpattern and a normalized correlation process, although many other kindsof measurements can also be used within the scope of the invention.

Object measurements are used to make decisions that produce informationdescribing an object. Information may describe presence or states ofbeing present, events such as an object crossing a reference point,location, velocity, brightness, contrast, and many others that willoccur to one of ordinary skill that can be obtained according to themethods and systems of the invention.

In an illustrative embodiment, accurate location information with nolatency is obtained by predicting the time at which an object will crossa reference point, and scheduling a signal to occur at the predictedtime. The prediction is obtained by fitting a curve, for example a line,through a set of (time, position) points, where the times correspond totimes at which images were captured and the positions are obtained fromimage measurements.

In an illustrative embodiment, latency can be adjusted using ahuman-machine interface, and even made negative, a novel capability.

In an illustrative embodiment the reference point can be set andadjusted precisely using a human-machine interface.

In an illustrative embodiment, a model pattern used in a normalizedcorrelation process for producing certain image measurements can beobtained with a training process that uses an example object to indicatethe desired appearance of objects to be detected and located.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be understood from the following detaileddescription, along with the accompanying figures, wherein:

FIG. 1 shows an example application of a system according to theinvention for detecting and locating discrete objects moving down aproduction line.

FIG. 2 shows an example application of a system according to theinvention for detecting and locating markings on a moving continuousweb.

FIG. 3 shows a block diagram of an illustrative apparatus.

FIG. 4 shows a portion of a capture process that obtains an image of afield of view, where the image is oriented approximately parallel to adirection of motion.

FIG. 5 shows a portion of a training process used to obtain a modelpattern for use in a measurement process of an illustrative embodiment.

FIG. 6 shows an object located at a certain position as part of ameasurement process of an illustrative embodiment.

FIG. 7 shows a timing diagram that explains decision delay, for use inconjunction with the discussion of latency and prediction.

FIG. 8 shows a prediction of the time at which an object will cross areference point, but with the crossing time too far in the future toschedule a signal.

FIG. 9 shows a prediction of the time at which an object will cross areference point, and the scheduling of a signal to occur at that time.

FIG. 10 shows a prediction of the time at which an object will cross areference point, but wherein the predicted time is in the past and asignal has already occurred.

FIG. 11 shows a flowchart of a portion of a selection process in anillustrative embodiment, portions of other processes that interact withthe selection process, and a memory used to hold values needed by theprocesses.

FIG. 12 shows a block diagram of a portion of a decision process in anillustrative embodiment, as well as portions of other processes thatinteract with the decision process.

FIG. 13 shows a human-machine interface used as part of a trainingprocess, and to set a reference point, in an illustrative embodiment, aswell as an example object used by the training process.

FIG. 14 shows a human-machine interface used to test the operation of anillustrative embodiment of a system according to the invention, as wellas an example object used in the testing.

FIG. 15 shows a human-machine interface used in an illustrativeembodiment to establish a direction of motion and place the system intoa running state, as well as an example object used in so doing.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description of the illustrative embodiments,reference is made to the accompanying drawings which form a part hereof,and in which are shown by way of illustration specific embodiments inwhich the invention may be practiced. It is to be understood that otherembodiments may be utilized and structural changes may be made withoutdeparting from the scope of the invention.

Some Definitions

As used herein the term linear detector refers to an optoelectronicsystem according to an embodiment of the invention, for purposes ofproviding information describing objects, herein equivalently referredto as object information. Similarly, the term linear detection methodrefers to a method according to an embodiment of the invention for likepurposes.

Applications of a linear detector include but are not limited toanalysis, detection, and location of objects. In an illustrativeembodiment intended for object detection, the object informationcomprises knowledge that an object has been detected in a certain state,for example crossing a reference point. In an illustrative embodimentintended for object location, the object information comprises the timewhen an object crosses a fixed reference point.

As used herein a process refers to systematic set of actions directed tosome purpose, carried out by any suitable apparatus, including but notlimited to a mechanism, device, component, software, or firmware, or anycombination thereof that work together in one location or a variety oflocations to carry out the intended actions. A system according to theinvention may include suitable processes, in addition to other elements.

The description herein generally describes embodiments of systemsaccording to the invention, wherein such systems comprise variousprocesses and other elements. It will be understood by one of ordinaryskill in the art that descriptions can easily be understood to describemethods according to the invention, where the processes and otherelements that comprise the systems would correspond to steps in themethods.

Example Applications

FIG. 1 illustrates an example application of an illustrative embodimentof the invention to detect and locate objects. Conveyer 100 moves boxes110, 112, 114, 116, and 118 in direction of motion 102. Each box in thisexample includes a label, such as example label 120, and a decorativemarking, such as example marking 122. A printer 130 prints characters,such as example characters 132, on each label as it passes by. In theexample of FIG. 1, the labels are the objects to be detected andlocated.

The illustrated linear detector 150 provides signal 134 to printer 130at times when labels to be printed pass, or are in some desirableposition relative to, reference point 106. In an illustrative embodimentsignal 134 comprises a pulse indicating that a label has been detected,and wherein the leading edge of the pulse occurs at the time that alabel is at reference point 106 and thereby serves to locate the label.

Linear detector 150 uses lens 164 to form a one-dimensional image offield of view 170 on linear optical sensor 160 comprising linear arrayof photoreceptors 162. Field of view 170 and linear array ofphotoreceptors 162 are oriented so as to produce one-dimensional imagesoriented approximately parallel to the direction of motion. Eachphotoreceptor makes a light measurement in the field of view.

In the example of FIG. 1, certain features of the boxes make the use ofprior art photoelectric sensors to detect and locate the labelsunsuitable. Photoelectric sensors are generally well-suited to detectthe edges of the boxes, but the labels are not in a fixed positionrelative to the box edges. For example, the label on box 118 is fartheraway from the left edge than the label on box 116. It is desirable,therefore, to detect the label itself, but the edge of the label isindistinguishable from the edge of the decorative marking, making priorart photoelectric sensors unsuitable.

The labels are much wider than the decorative markings, however, and thelight pattern corresponding to a label in field of view 170 can bedistinguished from the light pattern corresponding to a decorativemarking by appropriate analysis of the one-dimensional images, forexample by using a pattern detection process. The invention analyzes theimages to provide reliable detection and accurate location, as furtherdescribed below.

FIG. 2 illustrates another example application of the invention todetect and locate objects. Conveyer 200 moves continuous web 210 indirection of motion 202. Web 210 contains periodic reference marks, suchas example marks 220, 222, and 224. The marks move through field of view270 of linear detector 250 comprising linear optical sensor 260 on whichone-dimensional images of field of view 270 are focused. Linear opticalsensor 260 comprises linear array of photoreceptors 262. Field of view270 and linear array of photoreceptors 262 are oriented so as to produceone-dimensional images oriented approximately parallel to direction ofmotion 202.

Linear detector 250 may provide a signal (not shown) to suitableautomation equipment (not shown) at times when a reference mark crosses,or is in some desirable position relative to, reference point 206.

In the example of FIG. 2, reference marks comprise a pattern of shadesof gray that can be distinguished from other marks, features, defects,or shading that might appear on web 210, providing detection that issignificantly more reliable than could be achieved by prior artphotoelectric sensors.

Illustrative Apparatus

FIG. 3 is a block diagram of an illustrative embodiment of a portion ofa linear detector according to the invention. Microcontroller 300, suchas the AT91SAM7S64 sold by Atmel Corporation of San Jose, Calif.,comprises ARMv4T processor 310, read/write SRAM memory 320, read-onlyflash memory 322, universal synchronous/asynchronous receivertransmitter (USART) 330, parallel I/O interface (PIO) 332, and timer334. ARMv4T processor 310 controls the other elements of microcontroller300 and executes software instructions stored in either SRAM 320 orflash 322 for a variety of purposes. SRAM 320 holds data used by ARMv4Tprocessor 310. Microcontroller 300 operates at a clock frequency of 50MHz.

Linear optical sensor 340, such as the TSL3301-LF sold by Texas AdvancedOptoelectronic Solutions (TAOS) of Plano, Tex., comprises a linear arrayof 102 photoreceptors. Linear optical sensor 340, under control ofARMv4T processor 310 by commands issued using USART 330, can expose thelinear array of photoreceptors to light for an adjustable period of timecalled the exposure interval, and can digitize the resulting 102 lightmeasurements and transmit them in digital form to USART 330 for storagein SARI 320. Linear optical sensor 340, also under control of ARMv4Tprocessor 310, can apply an adjustable analog gain and offset to thelight measurements of each of three zones before being digitized, asdescribed in TAOS document TAOS0078, January 2006.

In an illustrative embodiment, linear optical sensor 340 is calibratedto compensate for any non-uniformity of illumination, optics, andresponse of the individual photoreceptors. A uniformly white object isplaced in the FOV, and the gain for each of the three zones is set sothat the brightest pixels are just below saturation. Then a calibrationvalue is computed for each pixel, such that when each gray level ismultiplied by the corresponding calibration value, a uniform image isproduced for the uniformly white object. The calibration values arestored in flash 322 and applied to subsequent captured images. Thecalibration values are limited such that each gray level is multipliedby no more than 8. Each image used by the calibration procedure isobtained by averaging 512 captured images.

Any suitable means can be employed to illuminate the FOV of linearoptical sensor 340. In an illustrative embodiment, two 630 nm LEDs areaimed at the FOV from one side of linear optical sensor 340, and two 516nm LEDs are aimed at the FOV from the other side. A light-shapingdiffuser, such as those manufactured by Luminit of Torrance, Calif., isplaced in front of the LEDs so that their beams are spread out parallelto linear optical sensor 340.

Human users of a linear detector, such as manufacturing technicians, cancontrol the system by means of human-machine interface (HMI) 350. In anillustrative embodiment, HMI 350 comprises an arrangement of buttons andindicator lights as further described below. ARMv4T processor 310controls HMI 350 using PIO interface 332. In other embodiments, an HMIconsists of a personal computer or like device; in still otherembodiments, no HMI is used.

The linear detector illustrated in FIG. 3 produces signal 362 forpurposes including indicating detection and location of objects. Signal362 is connected to automation equipment 360 as required by a givenapplication. Signal 362 is generated by timer 334 under control ofARMv4T processor 310. In an alternative embodiment, signal 362 isgenerated by PIO interface 332, also under control of ARMv4T processor310. Note that automation equipment 360 is shown for illustrativepurposes only; signal 362 may be used for any purpose and need not beconnected to any form of automation equipment, and signal 362 need notbe used at all.

In an illustrative embodiment, various processes are carried out by aninteracting collection of digital hardware elements, including thoseshown in the block diagram of FIG. 3, suitable software instructionsresiding in SRAM 320 or flash 322, and data residing in SRAM 320.

Processes Employed by Various Embodiments of a System According to theInvention

As used herein a motion process provides relative motion between theobjects and the field of view of an optical sensor, in some direction ofmotion. The objects, the sensor, and/or the field of view can be moving,as long as there is relative motion. Example motion processes include,but are not limited to: a conveyer moving objects past a fixed or movingsensor; a sensor attached to a robot arm that moves the sensor pastfixed or moving objects; a fixed object and a fixed sensor that usessome means, for example a moving mirror, to move the field of view; andobjects in freefall that pass a fixed or moving sensor.

As used herein a capture process obtains one-dimensional images of thefield of view of an optical sensor that makes light measurements. Theimages may be in any form that conveys information about light emergingfrom the field of view and is suitable for analysis by other processesas required. The images may be responsive to light of any color, anywavelength or range of wavelengths, any state of polarization, or anyother light characteristic or combination thereof that can be measured.The images may be analog, digital, or any combination; may reside in theoptical sensor, in memory external to the sensor, or any combination;and may be obtained by any suitable form of analog and/or digital signalprocessing, including but not limited to gain and offset, resampling,change in resolution, time filtering, and/or spatial filtering.

In the illustrative apparatus of FIG. 3, the capture process comprisesdigitizing the light measurements so as to obtain an array of numbers,called pixels, whose values, called gray levels, correspond to the lightmeasurements; transferring the pixels from linear optical sensor 340 tomicrocontroller 300; and storing the pixels into SRAM memory 320 forsubsequent analysis. Following the usual convention in the art, a pixelmay refer either to an element of the array of numbers, or to a unit ofdistance corresponding to the distance between two adjacent elements ofthe array. The array of pixels is a one-dimensional digital image.

The capture process operates cooperatively with the motion process so asto capture a plurality of one-dimensional images oriented approximatelyparallel to the direction of motion. This insures that at least aportion of the images will correspond to a plurality of positions of anobject relative to the field of view, providing a time-sequence ofimages of a slice of the object as it passes through the field of view.

It will be apparent to one skilled in the art that “approximatelyparallel” refers to any orientation that allows the linear detector toobtain a time-sequence of images of a slice of an object in a pluralityof positions as it enters, moves within, and/or exits the field of view.It will further be apparent that the range of orientations suitable foruse for with the systems and methods described herein has a limit thatdepends on a particular application of the invention. For example, ifthe orientation of the image is such that the angle between the imageorientation and the direction of motion is 5 degrees, the object willdrift 0.09 pixels perpendicular to the direction of motion for everypixel it moves parallel to that direction. If the range of the pluralityof positions covers 30 pixels in the direction of motion, for example,the drift will be only 2.6 pixels. If the systems and methods describedherein function as intended with a 2.6 pixel drift in a givenapplication of the invention, the example 5 degree orientation would beapproximately parallel for that application. Clearly, whether thesystems and methods described herein function as intended depends on thenature of the object, the desired performance of the invention (forexample accuracy and reliability), and other factors.

Similarly, it will be apparent to one skilled in the art that thedirection of motion need not be exactly uniform or consistent, as longas the systems and methods described herein function as intended.

The use of one-dimensional images allows very high capture and analysisrates at very low cost compared to prior art two-dimensional systems.The high capture and analysis rate allows many images of each object tobe analyzed as it passes through the field of view. The object motionensures that the image are obtained from a plurality viewingperspectives, giving far more information about the object than can beobtained from a single perspective. This information provides a basisfor reliable detection and accurate location.

Prior art linear array sensors oriented approximately perpendicular tothe direction of motion generally produce a single two-dimensional imageof each object. Such systems are useful but do not provide thecapabilities of the present invention.

While the illustrative embodiments of FIGS. 1, 2, and 3 use linearoptical sensors to produce one-dimensional images oriented approximatelyparallel to the direction of motion, it will be apparent to one skilledin the art that other types of optical sensors can also be used for likepurposes. For example, a two-dimensional optical sensor can be used tocapture two-dimensional images, portions of which are then converted toone-dimensional images oriented approximately parallel to the directionof motion. The conversion can be accomplished by any suitable form ofsignal processing, for example by averaging light measurementsapproximately perpendicular to the direction of motion. As anotherexample, a two-dimensional optical sensor capable of capturing so-calledregions of interest can be used. Many commercially available CMOSoptical sensors have this capability. A one-dimensional region ofinterest oriented approximately parallel to the direction of motionwould be functionally equivalent to a linear optical sensor. The imageportion or region of interest need not be the same for each capturedimage, but can be moved in any manner as long as the systems and methodsdescribed herein function as intended.

FIG. 4 shows a portion of an illustrative capture process that obtainsone-dimensional image 430 of field of view 410, where image 430 isoriented approximately parallel to direction of motion 400.

Light emitted from field of view 410 is focused onto an optical sensor(not shown), which makes light measurements. In the illustrative captureprocess of FIG. 4, 24 discrete light measurements are made in 24 zonesof field of view 410, such as example zone 440. The zones are shown asrectangular, contiguous, and non-overlapping for ease of illustration,but for typical sensors the geometry is more complex, due in part to thenature of the optics used to focus the light and the requirements ofsemiconductor fabrication.

In the illustrative capture process of FIG. 4, each light measurement isdigitized to produce 24 pixels, such as example pixel 450, whichcorresponds to example zone 440. The gray level of example pixel 450 is56, which is the light measurement for example zone 440.

The zones of FIG. 4 may correspond, for example, to individualphotoreceptors in a linear array sensor, or to a plurality ofphotoreceptors of a two-dimensional sensor that have been converted to asingle measurement by any suitable form of signal processing, asdescribed above.

The geometry of the light measurement zones of field of view 410 defineimage orientation 420 of image 430. Image 430 is oriented approximatelyparallel to direction of motion 400 if image orientation 420 anddirection of motion 400 are such that the capture process can obtain atime-sequence of images of a slice of an object in a plurality ofpositions as it enters, moves within, and/or exits the field of view.Note that image orientation 420 is a direction relative to field of view410, as defined by the geometry of light measurements contained in image430. The image itself is just an array of numbers residing in a digitalmemory; there is no significance to its horizontal orientation in FIG.4.

As used herein a measurement process makes measurements in the field ofview by analyzing captured images and producing values called imagemeasurements. Example image measurements include brightness, contrast,edge quality, edge position, number of edges, peak correlation value,and peak correlation position. Many other image measurements are knownin the art that can be used within the scope of the invention. Imagemeasurements may be obtained by any suitable form of analog and/ordigital signal processing.

In the illustrative embodiment of FIG. 3, a measurement processcomprises a digital computation carried out by ARMv4T processor 310,operating on a captured image stored in SARM 320, under the control ofsoftware instructions stored in either SRAM 320 or flash 322. Forexample, a brightness image measurement may be made by computing theaverage of the pixels of an image or portion thereof; a contrast imagemeasurement may be made by computing the standard deviation of thepixels of an image or portion thereof.

It is not necessary that the same image measurements be made in everycaptured image, or that the same number of image measurements be made.An embodiment of the invention may be such that for certain capturedimages no analysis is done and therefore no image measurements are made,but for clarity of description we ignore such images and assume that allcaptured images are analyzed by a measurement process.

In some applications of the invention there will be captured images forwhich no object is in the field of view, and therefore the imagemeasurements tell nothing about an object. In other applications anobject is always in the field of view, but not all image measurementsare relevant for determining object information. It may also be that allimage measurements are relevant, but at various points some objectinformation must be determined so a signal can be produced. Therefore, alinear detector according to some embodiments of the invention includesa selection process whose purpose is to select from among the imagemeasurements those that are judged responsive to the object. Imagemeasurements that are selected are called object measurements. Theselection process uses at least a portion of the image measurements todecide which ones to select, as will be described in more detail below.

In the illustrative embodiment of FIG. 3, a selection process comprisesa digital computation carried out by ARMv4T processor 310, operating onimage measurements stored in SARM 320 or in the registers of ARMv4Tprocessor 310, under the control of software instructions stored ineither SRAM 320 or flash 322.

A linear detector according to the invention may include a decisionprocess whose purpose is to analyze object measurements so as to produceobject information. In the illustrative embodiment of FIG. 3, a decisionprocess comprises a digital computation carried out by ARMv4T processor310, operating on object measurements stored in SARM 320 or in theregisters of ARMv4T processor 310, under the control of softwareinstructions stored in either SRAM 320 or flash 322.

A linear detector according to some embodiments of the invention mayoptionally include a signaling process whose purpose is to produce asignal that communicates object information. A signal can take any formknown in the art, including but not limited to an electrical pulse, ananalog voltage or current, data transmitted on a serial, USB, orEthernet line, radio or light transmission, and messages sent orfunction calls to software routines. The signal may be producedautonomously by the linear detector, or may be produced in response to arequest from other equipment.

In the illustrative embodiment of FIG. 3, a signaling process comprisesa digital computation carried out by ARMv4T processor 310, operating onobject information stored in SARM 320 or in the registers of ARMv4Tprocessor 310, producing signal 362 by means of timer 334, and under thecontrol of software instructions stored in either SRAM 320 or flash 322.Signal 362 is an electrical pulse, and timer 334 is used by ARMv4Tprocessor 310 to insure that the pulse appears at a precise time.

It should be clear that any combination of processes that interact inany way is also a process. Thus the description of various embodimentsas comprising various specific processes is made for convenience andease of comprehension only. Any rearrangement of an embodiment into moreor fewer processes that combine to carry out an equivalent set ofactions directed to an equivalent purpose shall be understood toconstitute an equivalent embodiment.

Overview of a Measurement Process

Often it is desirable to make an image measurement that is responsive toobject presence in the field of view, so that a selection process canuse that measurement to select object measurements judged responsive toan object. More specifically, the measurement process would compute avalue (or set of values), called herein score measurements, indicativeof the likelihood or level of confidence that an object is present; forexample, higher values mean more likely or more confident. Imagemeasurements made from a given image can be selected when the level ofconfidence that an object is present is judged to be sufficientaccording to some criteria, although certain image measurements mightalso be selected unconditionally or according to some other criteria.

Many kinds of image measurements are suitable for determining aconfidence level that an object is present, and the choice of which touse depends on the application for which a linear detector is intended.Image measurements including brightness, contrast, edge quality, numberof edges, and peak correlation value can be used, as well as many othersthat will occur to a person of ordinary skill in the art.

Often it is desirable to make an image measurement that is responsive toobject position in the field of view. Such a measurement is calledherein a position measurement. A selection process can use such ameasurement, as will be seen below in the description of FIG. 11. Adecision process can use such a measurement to locate an object. Manykinds of image measurements suitable for estimating object position areknown in the art; an illustrative embodiment is described below.

Of particular interest are measurement processes that incorporate apattern detection process. A pattern detection process is one that isresponsive to the spatial arrangement of gray levels in an image. Forexample a brightness measurement made by computing an average of pixels,or a contrast measurement made by computing the standard deviation ofpixels, are not pattern detection processes because the results areindependent of the spatial arrangement of the gray levels. Examples ofpattern detection processes include edge detection and correlation; manyothers are well-known in the art.

Measurement Process for an Illustrative Embodiment

FIGS. 5 and 6 illustrate image measurements that are responsive toobject presence and object position, as produced by a measurementprocess used by an illustrative embodiment. The measurement processincorporates a normalized correlation process based on the well-knownnormalized correlation operation. A normalized correlation process is anexample of a pattern detection process, and uses a model pattern thatcorresponds to an expected pattern of gray levels in an image of anobject in the field of view. It searches for the position in a capturedimage that is most similar to the model pattern, producing imagemeasurements including the degree of similarity at that position, whichis an example of a score measurement, and the position itself, which isan example of a position measurement. Note that if there is no positionin a captured image that is sufficiently similar, the positionmeasurement may be meaningless. Normalized correlation provides numerousbenefits that are well-known in the art.

The score measurement is responsive to object presence, and the positionmeasurement is responsive to object position. In an illustrativeembodiment, the score measurement is min(r, 0)², where r is thenormalized correlation coefficient, and the position measurementprovides sub-pixel accuracy using the well-known parabolic interpolationmethod.

A model pattern can comprise any pattern of gray levels, including asimple edge pattern consisting of two gray levels or a complex patterncontaining many gray levels. It can be obtained in a variety of ways,including from prior knowledge of the expected pattern of gray levels,and from an example object using a training process.

FIG. 5 illustrates obtaining a model pattern using a training process inan illustrative embodiment. An example object 500 is placed in field ofview 502. The example object comprises a light pattern including brightregions 510 and 517, dark regions 513 and 515, medium-bright regions 512and 514, and medium-dark regions 511 and 516.

The training process captures one-dimensional training image 540 fromexample object 500. The training image 540 is illustrated by graph 520,which plots gray level as a function of position in the image. Theposition of the pattern in the training image is arbitrarily defined tobe at 0, as indicated by origin line 532, which in this example is alsothe reference point, passing through the boundary between region 513 and514.

In the illustrative embodiment of FIG. 5, model pattern 542 is obtainedfrom the portion of training image 540 that lies between first position530 at −25 and second position 534 at +35. It can be seen that trainingimage 540 is subject to some noise, and so model pattern 542 is obtainedby averaging 512 captured images and then smoothing using a three-pixelwide boxcar filter. Any method known in the art can be used to obtain amodel pattern from one or more training images, including nomodification at all. One example of a well-known method uses multipleexample objects and averages training images captured from each suchobject.

In the illustrative embodiment of FIG. 5, image 540 contains 100 pixelsand model pattern 542 contains 60 pixels. In this embodiment thenormalized correlation process looks for the peak position only wherethe model pattern lies entirely within the image, so there are 41 suchpositions. Various performance characteristics, such as speed, range,and discrimination, can be altered as needed by adjusting these sizes.Such adjustment can be carried out by HMI 350, by programming suitablevalues into the software, or by other well-known means. In anotherillustrative embodiment designed to operate at higher speeds but withsmaller range and somewhat less discrimination, the image size is 84pixels and the model pattern size is 54 pixels.

For embodiments along the lines of the foregoing discussion, a modelshould be at least 3 pixels and captured images should be at least aslarge as the model, but otherwise there are no limits to the image andmodel sizes. One skilled in the art will understand that different sizesrepresent different engineering tradeoffs among speed, range,discrimination, and other characteristics.

In the illustrative embodiment of FIG. 5 the direction of motion is leftto right, i.e. in the direction of increasing positions. It can be seenthat the portion of training image 540 that is used to obtain modelpattern 542 has been offset downstream from the center of the field ofview, in this example by 5 pixels. This allows model pattern 542 to fitcompletely within the 100-pixel image 540 in more positions between theupstream end and the reference point at origin line 532, providing moredata for prediction as discussed below. In general the offset can beadjusted by HMI 350, by programming suitable values into the software,or by other well-known means. The offset can be calculated responsive tothe location of the reference point and/or the desired latency, and neednot be used at all.

FIG. 6 illustrates a measurement process making an image measurementresponsive to object position using a normalized correlation processthat is responsive to model pattern 542. Object 600, having a lightpattern similar to that of example object 500, is at some position infield of view 602 at the time that image 640 is captured, as shown bygraph 620.

Graph 622 shows model pattern 642 at the peak position, in this exampleat position −15. In this example, therefore, the measurement processmakes an image measurement of object position in captured image 640, theimage measurement being −15 pixels.

Since model pattern 642 is very similar to image 640 at the peakposition, the score will be high and so the measurement process willmake an image measurement of object presence that indicates highconfidence that an object is present in the field of view at the timethat image 640 is captured. Since the confidence is high, these twoimage measurements may be assumed to be responsive to the object, andcan be selected to be included in the object measurements.

The foregoing description of a measurement process pertains to specificembodiments, and it is contemplated that significant modifications orentirely different methods and processes that occur to one skilled inthe art can be used to achieve similar effects, or other desired effectsin accordance with the teachings described herein. For example, all ofthe numerical constants used are understood to be examples and notlimiting. A model can be obtained from prior knowledge of objectsinstead of from a training image. Well-known edge detection methods thatuse gradient instead of correlation and models can be used to providescore and position measurements, for example.

Latency and Prediction

Consider an object moving so as to cross a reference point at areference time. A common way to design a sensor to detect and locate theobject is to produce a signal, typically a pulse, at the precise timethat the object crosses the reference point. The existence of the pulseserves to indicate that an object is detected, and the timing of thepulse serves to indicate its location by giving the time at which theobject is located at the known reference point. Using the signal,desired automation equipment can act on the object when it is in a knownlocation. It is important that the signal is produced when the object ispresent, and not produced at other times in response to whatever elsemay be happening in front of the sensor.

Of course in practice any system or method can only estimate thereference time, so there will be some error. The mean error, i.e. theaverage interval from the reference time to the signal time, is usuallyreferred to in the art as latency or response time. Prior art devicesexhibit some latency, typically of the order of hundreds ormicroseconds. The effect of latency is that the object has moveddownstream from the reference point when the signal occurs, and by anamount that varies with the speed of motion. If the latency and speedare precisely known, automation equipment can be set up to act on theobject in a known location. In practice, of course, latency and speedare known imprecisely, resulting in location errors that increase asspeed or latency increases. An encoder or similar device can be used tocompensate for poor knowledge of speed, but not latency.

The standard deviation of the errors is a measure of the repeatabilityof the system or method. These errors are random and cannot becompensated for. Overall accuracy combines the effects of latency andrepeatability.

Latency results because it takes some time for a sensor to decidereliably that the object is present. Generally taking more time to makea decision results in more reliable decisions. A simple phototransistorcould have an insignificant latency of a few nanoseconds, for example,but it would respond incorrectly to so many things that it would beuseless. Prior art sensors make a tradeoff between acceptable latencyand acceptable reliability.

FIG. 7 shows this decision delay for the illustrative apparatus of FIG.3. Image capture begins when linear optical sensor 340 exposes itsphotoreceptors to light for exposure interval 700. Under control ofARMv4T processor 310, pixels are transferred to SRAM 320. This transfertakes transfer interval 710. Measurement, selection, and decisionprocesses then run on ARMv4T processor 310 over compute interval 720.The earliest any action (such as producing a signal) can be taken basedon measurements in the image corresponding to exposure interval 700 isat decision point 740, which is delayed by decision delay 750 from themiddle 730 of exposure interval 700. The decision process can only haveknowledge of the past, not the present.

Note that in the illustrative apparatus of FIG. 3 the exposure,transfer, and compute intervals can all be overlapped, so the intervalbetween images is only the largest of the three intervals, not theirsum. This allows much higher time resolution, but does not in any wayreduce decision delay 750.

While a decision delay is unavoidable, latency is not. The inventioneliminates latency by predicting when the object will cross thereference point, and scheduling a signal to occur at that time.Prediction is accurate when there is sufficient knowledge of the motionof the object, both from measurements of how it has been moving andexpectation that it will continue to do so for sufficient time in thefuture.

The invention also allows detection to be much more reliable than priorart systems even when the latency is zero or negative. Detection isbased on many images, covering a span of time that can be manymilliseconds long, allowing careful decision making without sacrificinglatency. Furthermore, detection based on pattern detection includingnormalized correlation is fundamentally better able to distinguish thedesired object from other things happening in the field of view.

By using a good prediction method, latency can also be made negative. Inpractice the range of negative latency that can be achieved is limited,but it provides new capabilities over the prior art that can be useful.If the automation equipment has a short latency between receiving thesignal and acting, for example, a negative latency in a linear detectoraccording to the invention can be used to offset the equipment latencyso that the total system latency is zero.

Of course, no practical system or method can have a latency that isexactly zero; herein the term no latency will refer to systems ormethods where the latency is significantly less than the repeatability.For such systems or methods, the signal will sometimes arrive before thereference time, and sometimes after.

Prediction in an Illustrative Embodiment

In an illustrative embodiment, a capture process captures images aspreviously described, and in addition produces a capture time (t) foreach image, corresponding to the middle of the exposure time. Forexample, capture time can be determined by ARMv4T processor 310 byreading timer 334 at the middle of the exposure interval, or at someother point and correcting for the time difference between that pointand the middle of the exposure interval.

Employing a measurement process using normalized correlation asdescribed above, a set of score (s), position (x) pairs are obtained foran object moving through the field of view. Thus for each captured imagewe have three values (s, t, x); two image measurements from themeasurement process and a capture time from the capture process. In thissection we will consider (t, x) pairs only, ignore the selectionprocess, and consider only that portion of the detection and signalingprocesses that pertains to prediction. Selection and detection will befurther described in other sections below.

Prediction accuracy comes from several factors. For example, in theillustrative embodiment, a linear detector according to the inventionoperates at over 8000 images per second and assumes that motion is atconstant velocity. Decision delay 750 is typically under 300 μs. Hightime resolution of about 125 μs allows accurate t measurements and many(t, x) pairs to be obtained for each object as it approaches thereference point. The short decision delay means that any deviations fromconstant speed occur over a very short interval. Use of normalizedcorrelation with sub-pixel interpolation provide accurate xmeasurements.

FIGS. 8-10 show prediction and signal generation for an illustrativeembodiment. Note that prediction in this embodiment is a combined effectof the capture, measurement, selection, and decision processes operatingin concert.

FIG. 8 shows a plot 800 of capture time t vs. object position x for anobject moving through the field of view. Time values are in microsecondsfrom some arbitrary starting point, and position values are in pixelsmeasured from reference point 822. Time values come from the captureprocess and position values come from the measurement process, asdescribed elsewhere. The measurement process also produces scoremeasurements s for each point, not shown. For simplicity of illustrationthe image capture/transfer/compute rate is about 10 KHz, giving a periodof about 100 μs.

(t, x) points are plotted, including example point 810. Current time 832is shown, and corresponds to decision point 740 for an image whoseexposure interval is centered on exposure time 830, the most recent timefor which a position measurement is available. Decision delay 840 is theinterval between exposure time 830 and current time 832. So far threepoints have been obtained.

In the illustrative embodiment, three points of sufficiently high scoreare considered sufficient to make a prediction of the reference time.The predication is made using best-fit line 820 through the three pointsobtained so far, where line 820 is computed by the well-known leastsquares method. The predicted time 834 is the time at which best-fitline 820 crosses reference point 822.

It is of course possible to fit any suitable curve to (t, x) points,where the curve represent some function f wherein x=f(t). Clearlybest-fit line 820 is an example of such a curve, corresponding to anassumption of constant velocity. In another embodiment wherein constantacceleration is assumed, a best-fit parabola could be used.

In the example of FIG. 8, signal delay interval 842 from current time832 to predicted time 834 is about 2170 μs. In the illustrativeembodiment, a signal delay interval greater than 1000 μs is consideredtoo long to be reliable; not only is the predicted time inaccurate, butthere isn't sufficient evidence that the object will indeed cross thereference point at all. Therefore, no signal is scheduled.

FIG. 9 shows a plot 900 similar to that of FIG. 8. In this case,however, 15 (t, x) points have been obtained, including example point910. Current time 932, most recent exposure time 930, and decision delay940 are shown. Best fit line 920 crosses reference point 922 atpredicted time 934. Signal delay interval 942 is about 190 μs. Sincethere are at least three points of sufficiently high score, and signaldelay interval 942 is less than 1000 μs, a signal is scheduled to occurat predicted time 934.

Given the criteria for scheduling a signal in the illustrativeembodiment, it is clear that a signal would have been scheduled manytimes prior to current time 932. For example, at time 950 when point 952was the most recent data available, the criteria would also be met and apulse would have been scheduled. As the object moves closer to referencepoint 922, the prediction becomes more accurate because there are morepoints with which to fit the line, and because the prediction is less ofan extrapolation. Therefore, when a signal is scheduled it replaces anypreviously scheduled signal, so that in effect the predicted signal timeis updated for every image as the object approaches the reference point.

FIG. 10 shows a plot 1000 similar to that of FIG. 8. In this case,however, 17 (t, x) points have been obtained, including example point1010. Current time 1032, most recent exposure time 1030, and decisiondelay 1040 are shown. Best fit line 1020 crosses reference point 1022 atpredicted time 1034. Signal delay interval 1042 is negative by about 130μs, which means that the signal should have already happened due to apreviously scheduled signal.

There are two cases. First, if a signal has indeed happened, as shown inFIG. 10 by pulse edge 1050 occurring before current time 1032, there isnothing left to do for the current object. No signal is scheduled. Iffor some reason a signal has not yet happened (one may be scheduled butnot yet happened, or none may be scheduled), a signal is producedimmediately.

While FIGS. 8-10 and the accompanying description describe an embodimentwith no latency, it is possible to introduce a positive or negativelatency by adding a positive or negative value to the predictedreference time, e.g. times 834, 934, and 1034. The latency can be madeadjustable using HMI 350. Other than the additional mechanism for addingthis value, the above-described embodiment remains unchanged. No matterwhat the latency, the signal is generated with the best available data.

The added latency can be viewed as decreasing the decision delay, e.g.750, 840, 940, and 1040, by the latency value. Positive latencyeffectively makes the decision delay shorter, and negative latencyeffectively makes it longer. When the latency equals the actual decisiondelay, the effective decision delay is 0 and the signal generation is nolonger a prediction, and the extrapolation becomes an interpolation. Aslatency increases, furthermore, more data points can be obtained for theline fitting. Thus signal timing accuracy increases as latencyincreases.

With no latency, the best reference point is at the downstream end ofthe field of view. This allows the entire FOV to be used and the maximumnumber of (t, x) points to be produced for the prediction. As thereference point moves upstream less of the FOV is used and fewer pointsare available, reducing accuracy. If the reference point is too farupstream in the FOV, the system will not operate properly.

As the reference point moves beyond the FOV downstream, theextrapolation is greater and accuracy will suffer. At some point it willno longer be possible to satisfy the 1000 μs maximum signal delayinterval criterion. In an illustrative embodiment, once an object movescompletely out of the FOV the signal is scheduled regardless of thesignal delay interval.

The forgoing discussion of prediction pertains to specific embodimentsand it is contemplated that significant modifications or entirelydifferent methods and processes that occur to one skilled in the art canbe used to achieve similar effects, or other desired effects inaccordance with the teachings described herein. For example, all of thenumerical constants used are understood to be examples and not limiting.It is not necessary that any signal delay be considered too long to bereliable. The maximum reliable signal delay, and the minimum number ofpoints needed to schedule a signal, can vary from image to image orobject to object based on any desired criteria. A limit on the maximumnumber of points could be used, such that once such a limit is reachedno rescheduling of the signal would occur.

Illustrative Selection Process

There are a wide variety of ways to arrange a selection process and adecision process for a linear detector according to the invention. Insome embodiments, the two processes operate independently—the selectionprocess chooses object measurements from the image measurements, andpasses these along to the decision process, in a manner that isresponsive to the image measurements but not to anything that thedecision process does. In an illustrative embodiment the selectionprocess, shown by the flowchart of FIG. 11 and described in thissection, operates in concert with the decision processes to select theobject measurements and use them to detect and locate an object. Thuswhile the two processes will be shown by separate figures and describedin separate sections, there will be of necessity some overlap ofdescription. Furthermore, as noted above, the selection and decisionprocesses could equivalently be combined into one complex process, butdescribing them separately aids clarity.

As described above, for each captured image we have three values (s, t,x); two image measurements from the measurement process and a capturetime from the capture process. A selection process must select objectmeasurements from among the image measurements (s, x), to be passedalong to the decision process. In the illustrative embodiment selectionis done on a per-image basis, so an (s, x) pair is either selected ornot from a given image. Capture time for a selected image is thenincluded, so the decision process gets (s, t, x) triplets from selectedimages. Any other suitable strategy for selecting object measurementsfrom image measurements, with or without capture times or other data,can be used within the scope of the invention.

The selection process ignores image measurements when no object appearsto be passing through the FOV. The selection process is called inactiveat these times.

When an object appears to be passing through the FOV, the selectionprocess is called active. It selects a set of (s, t, x) triplets to beused by the decision process to decide if an object has been detected,and, if so, to locate it by calculating the reference time, wherein thecalculation may or may not be a prediction depending on the desiredlatency as described above.

The selection process may select some or all of the tripletscorresponding to each object, although in typical cases only some areselected. The rules will now be summarized, and then described in detailin conjunction with FIG. 11. In the following description, numericalconstants pertain to the illustrative embodiment; any other suitablevalues or methods for carrying out selection can be used within thescope of the invention.

Selection for a given object begins (i.e. the selection process becomesactive) when an image is found for which s≧0.6 and x is upstream fromthe reference point by at least 2 pixels. The upstream requirementprovides hysteresis in object detection; an object that is stationary ormoving very slowly will not be detected multiple times as it crosses thereference point.

If selection is active and s<0.6 for 3 consecutive images, the object isconsidered to have passed through the field of view, and selectionbecomes inactive.

No more than 128 triplets are used for any object, because as the valuesget older they tend to be a less reliable indication of what ishappening in the present. Three 128-element first-in first-out (FIFO)buffers are used to hold the most recent triplets. New triplets areadded to the FIFOs, and if they are full the oldest triplet is removedand its object measurements are deselected, as if they were neverselected in the first place. It can be seen that the selection processis inactive when the FIFOs are empty, and active otherwise.

If the FIFOs are full and the x measurements within are centered aroundthe reference point, selection ends and becomes inactive. This rule isuseful in the case where the desired latency is long enough thatreference time can be calculated by interpolation (i.e. not predicted);once the FIFOs are full and the x measurements are centered about thereference point, any additional measurements will degrade the accuracyof the interpolation.

In the following description of FIG. 11, it is assumed that thedirection of motion is positive x, so that downstream positions have xvalues greater than upstream positions. It will be clear to one skilledin the art how to modify the description so as to have a negativedirection of motion, or to have objects be detected and located movingin either direction.

In FIG. 11, reset step 1100 clears the FIFOs (see FIG. 12), makingselection inactive. This is used for system initialization and at timeswhen selection ends for a given object.

Capture step 1102 (a portion of the capture process) captures the nextimage, also producing capture time (t) 1164. Search step 1104 (a portionof the measurement process) uses normalized correlation to produce score(s) 1160 and position (x) 1162. Presence test step 1106 judges the levelof confidence that an object is present in the field of view; if score1160≧0.6, the level of confidence is considered sufficient to indicateobject presence. Note that this does not mean that an object is judgedto be actually present; that decision is reserved for the decisionprocess based on an analysis of all of the selected triplets.

If no object is judged present, first active test step 1108 directs theselection process to continue looking for an object if selection isinactive (“yes” branch). If no object is judged present but first activetest step 1108 indicates that selection is active, increment step 1110,missing test step 1112, and missing counter 1150 are used to detect 3consecutive images for which no object appears present. If fewer than 3such image are detected so far, control returns to capture step 1102.

If 3 consecutive images for which no object appears present are detectedwhen selection is active, final decision step 1132 (a portion of thedecision process) is entered. If three conditions are met, first signalstep 1134 (a portion of a signaling process) schedules a signal to beproduced at signal time (z) 1170 (computed as described below). Thefirst condition is that no signal has already been scheduled or hasoccurred. The second condition is that crossed flag 1152 indicates thatthe object has actually crossed the reference point. The third conditionis the good points counter (g) 1174 (maintained by the decision process)indicates that at least 3 triplets in the FIFOs have s≧0.75. This thirdcondition is the criterion that the decision process uses to decide thatan object is detected. Whether or not a signal is scheduled, controlreturns to reset step 1100.

If presence test step 1106 judges that the level of confidence issufficient (score 1160≧0.6), missing initialize step 1114 sets missingcounter 1150 to 0. Second active test step 1116 determines whether ornot this is the first image of a new object. If it is (“yes” branch),hysteresis test step 1121 determines whether or not the object appearssufficiently upstream of reference point (r) 1154. If not (“no” branch),control transfers to capture step 1102, and selection remains inactive.If the object is sufficiently upstream, crossed initialize step 1122sets crossed flag 1152 to false. Selection now becomes active.

If second active test step 1116 indicates that this is not the firstimage of a new object (“no” branch), cross test step 1118 and cross setstep 1120 set crossed flag 1152 to true if the object crosses referencepoint 1154.

When control transfers to line fit step 1124 (a portion of the decisionprocess), object measurements score 1160 and position 1162 have beenselected, and capture time 1164 is available. These values are used tocalculate a best fit line as described above in relation to FIGS. 8, 9,and 10, and below in relation to FIG. 12. The results of thesecalculations include signal time (z) 1170, object velocity (v) 1172, andgood points counter (g) 1174.

Running decision step 1126 implements the signal scheduling rulesdescribed in relation to FIGS. 8, 9, and 10. A signal is scheduled forsignal time 1170 by second signal step 1128 if four conditions are met:

-   -   1. The signal has not already happened;    -   2. Signal time 1170 is within 1 ms. of the current time (which        includes cases where the current time has passed signal time        1170);    -   3. Object velocity 1172 indicates downstream motion (crossed        flag 1152 cannot be used here because the object may only be        predicted to cross reference point 1154 at some future time;        requiring downstream motion is a suitable alternative);    -   4. Good points counter 1174 indicates that at least 3 triplets        in the FIFOs have s≧0.75.

Centered test step 1130 implements the rule described above for the casewhere the FIFOs are full and the x measurements are centered aroundreference point 1154. Note that the test for centered measurements iswritten as Σx>128r, which requires that the average x in the FIFOexceeds reference point 1154. The assumptions here apply to theillustrative embodiment: the direction of motion is positive and theFIFOs contain 128 elements. The test is written to avoid a divide, whichis typically much more expensive than a multiply. Of course dividing by128 is just an inexpensive shift, but in other embodiments the FIFO sizemight not be a power of 2.

If centered test step 1130 passes (“yes” branch”), control transfers tofinal decision step 1132 and selection will become inactive at resetstep 1100. If the test fails (“no” branch), control passes to capturestep 1102 and selection remains active.

In should be noted that in the illustrative embodiment, if a scheduledsignal occurs it does not cause selection to become inactive. Noadditional signal will be scheduled because running decision step 1126and final decision step 1132 will always fail (“no” branches), butselection waits for the object to pass through to FOV, or for the xmeasurement to be centered, before becoming inactive. This is furtherinsurance (in addition to the hysteresis provided by hysteresis teststep 1121) against multiple detections for one object.

Other benefits arise from keeping selection active even though a signalhas already occurred. One is that an interpolated reference time can beobtained some time after the reference point has been crossed. Thisshould be more accurate than any predicted time, and can be comparedwith a predicted time to assess system accuracy and to automaticallyadjust to eliminate any residual latency in the system. Another is thatother characteristics of the object (such as its velocity) can beobtained and, if desired, communicated by means of other signals.

Missing counter 1150, crossed flag 1152, reference point 1154, score1160, position 1162, capture time 1164, signal time 1170, velocity 1172,and good points counter 1174 are stored in memory 1180, which can be aportion of SRAM 320.

The forgoing discussion of a selection process pertains to specificembodiments and it is contemplated that significant modifications orentirely different methods and processes that occur to one skilled inthe art can be used to achieve similar effects, or other desired effectsin accordance with the teachings described herein. For example, all ofthe numerical constants used are understood to be examples and notlimiting. The rules for scheduling a signal can be changed asappropriate. There need not be a limit on the number of triplets usedfor an object. Good points counter 1174 can be eliminated, or replacedwith different statistics such as an average of the scores in the FIFO,for example.

Illustrative Decision Process

FIG. 12 shows a decision process portion 1280 used in the illustrativeembodiment described above in relation to FIGS. 8, 9, 10, and 11. Acapture process provides image 1200, and normalized correlation process1210 uses model 1202 to produce image measurements position (x) 1216 andscore (s) 1218. A capture process uses clock 1212 to produce capturetime (t) 1214.

Selected (s, t, x) triplets are passed to decision process portion 1280and placed in capture time FIFO 1220, position FIFO 1222, and score FIFO1224, which together comprise FIFOs 1226 as further described above.Selected (s, t, x) triplets are also passed to statistics element 1230,which computes Σt, Σt², Σx, Σtx, and Σ(s≧0.75) as required for thewell-known least-squared line fit and for good points counter 1174. Sumsare computed by addition element 1232, and are taken over all thetriplets in FIFOs 1226.

If FIFOs 1226 are full when a new (s, t, x) triplet is selected, theoldest triplet is passed to subtraction element 1234 which subtractsfrom the above sums as required to effectively deselect themeasurements. It can be seen that at most one set of additions and oneset of subtractions are needed for each selected (s, t, x) triplet; itis not necessary to recompute the sums over the entire contents of FIFOs1226 for each triplet.

For reasons of numerical accuracy and computational efficiency, it isdesirable to keep all of the sums using t values that are relative tothe oldest time in capture time FIFO 1220. This requires a somewhat morecomplex procedure for handling a new triplet when FIFOs 1226 are full,but the extra cost of doing so is more than offset by other savings inmany embodiments.

In the formulas below for updating the sums when FIFOs 1226 are full,make the following definitions:

-   t new capture time 1214-   x new position 1216-   t₀ oldest time from capture time FIFO 1220-   t₁ second oldest time from capture time FIFO 1220-   x₀ oldest position from position FIFO 1222-   T current Σt-   Q current Σt²-   X current Σx-   C current Σtx-   T′ updated Σt-   Q′ updated Σt²-   X′ updated Σx-   C′ updated Σtx-   N size of FIFOs 1226 (128 in illustrative embodiment)-   t_(u) t₁−t₀-   t_(v) t−t₀

The update formulas for the sums are:

X′=X+x−x ₀

T′=T+t _(v) −Nt _(u)

Q′=Q+t _(u)[(N−1 )t _(u)−2T]+(t _(v) −t _(u))²

C′=C+t _(u)(x ₀ −X)+x(t _(v) −t _(u))

For each selected (s, t, x) triplet, detection element 1240 decideswhether or not there are at least 3 scores in score FIFO 1224 that areat least 0.75, i.e. [Σ(s≧0.75)]≦3. If not, the decision process judgesthat no object has yet been detected and so no signal is produced bysignaling process 1260. Detection element 1240 corresponds to a portionof running decision step 1126 and final decision step 1132, wherein atest is made for good points counter (g) 1174≦3.

For each selected (s, t, x) triplet, line fit element 1250 uses sumscomputed by statistics element 1230, latency value 1252, and referencepoint value 1254, to compute a best-fit line and, from the parameters ofthat line, signal time 1170 used by the selection process of FIG. 11 andsignaling process 1260, and object velocity 1172 used by the selectionprocess of FIG. 11. Well-known formulas are used to compute the best-fitline, signal time 1170, and object velocity 1172 (which is just theslope of the best-fit line).

Latency value 1252 and reference point value 1254 are stored in SRAM 320(FIG. 3), and can be adjusted if desired using HMI 350.

The forgoing discussion of a decision process pertains to specificembodiments and it is contemplated that significant modifications orentirely different methods and processes that occur to one skilled inthe art can be used to achieve similar effects, or other desired effectsin accordance with the teachings described herein. For example, all ofthe numerical constants used are understood to be examples and notlimiting. Other curves can be fit to the points instead of a line. Aweighted line fit can be used, where for example the weights are afunction of the age of the points.

Illustrative Signaling Process

The signaling process of an illustrative embodiment has been describedabove in relation to timer 334 and signal 362 of FIG. 3; signalscheduling in relation to FIGS. 8, 9, and 10; pulse edge 1050 of FIG.10; first signal step 1134 and second signal step 1128 of FIG. 11; andsignaling process 1260 of FIG. 12.

Timer 334 is set up to run at 1/32 of microcontroller 300 clock rate,giving a resolution of 0.64 μs. It can easily be set up to produce apulse after a programmable delay (see ATMEL document6175E-ATARM-04-Apr-06), which would be equal to the difference betweenthe desired signal time and the current time.

To achieve slightly higher timing accuracy, timer 334 is used for bothclock 1212 and pulse edge 1050 (which appears on signal 362). When asignal is scheduled for a certain time, the compare registers of timer334 are set to produce the pulse edges The compare registers are seton-the-fly, without stopping the timer, and only if the pulse has notyet started due to a previous scheduling. The desired operation can beachieved with a suitable assembly language routine that runs withinterrupts off.

The forgoing discussion of a signaling process pertains to specificembodiments and it is contemplated that significant modifications orentirely different methods and processes that occur to one skilled inthe art can be used to achieve similar effects, or other desired effectsin accordance with the teachings described herein. Signals need not bepulse edges and can be produced by many other means known in the art.Many different software and hardware elements can be used to achievedesired effects.

Additional Object Information Produced by a Decision Process

It will be apparent to one skilled in the art that, based on the abovediscussion of illustrative measurement, selection, and decisionprocesses, a wide range of object information can be produced by adecision process that analyzes object measurements. This objectinformation includes, but is not limited to, knowledge responsive toobject presence in the field of view, and more particularly to a stateof being present, or an event comprising a transition among such states,or both.

Examples of states of being present include, but are not limited to:

-   -   an object is in the FOV;    -   an object is in the FOV upstream from a reference point;    -   an object is in the FOV downstream from a reference point;    -   an object is moving in the FOV at or above a certain velocity;        and    -   an object is in the FOV between two reference points.

Examples of events include, but are not limited to:

-   -   an object enters the FOV;    -   an object passes through the FOV;    -   an object crosses a reference point in either direction;    -   an object crosses a reference point in a specific direction;    -   an object reaches an apex of motion in the FOV; and    -   an object comes to rest in the FOV.

In order to more fully understand illustrative embodiments that produceknowledge responsive to object presence in the field of view, consideran example. Let Mbe the set of image measurements produced by ameasurement process. Let P be a subset (maybe all) of M containing thoseimage measurements that are responsive to image presence. The selectionprocess is responsive to some or all of P and produces objectmeasurements S, a subset of M. S may contain some, all, or none of P. Sis used to get the knowledge responsive to object presence in the fieldof view. It may be that no measurement in S is responsive to objectpresence, but still all of S is responsive to the object because of howthey were selected.

To make this concrete, suppose that M includes score and positionmeasurements. Score measurements are responsive to objectpresence—higher values mean the object is more likely to be present.These are the subset P that the selection step uses. Positionmeasurements are not responsive to object presence—one cannot tell bythe value of a position measurement whether an object is present or not.If there is no object, the position measurements will be meaningless(just noise), but one cannot tell that from their values. So theselection step uses the score values (subset P) to select themeasurements in S, which may be just position measurements. While thoseposition measurements are not responsive to object presence, the factthat they are selected means that they are responsive to the objectbecause, having been selected responsive to the scores, they are theones that give valid object positions. A decision process can use theseselected object positions to determine, for example, whether an objecthas crossed a reference point.

Illustrative HMI for Training Process, Setting a Reference Point,Testing, and/or Running

FIG. 13 shows an HMI and example box for a training process, and forsetting a reference point, as might be employed in setting up a lineardetector for use in the application shown in FIG. 1.

Example box 1300 containing example object 1302 (a label on example box1300) and decorative marking 1304 is placed so that example object 1302appears in FOV 1312 of a linear detector (not shown). Reference point1310 is also shown.

HMI 1320 contains train button 1330, run button 1332, negative positionindicator 1340, positive position indicator 1342, negative directionindicator 1350, and positive direction indicator 1352. When train button1330 is pressed with example object 1302 in FOV 1312, one or more imagesare captured and used to create a model as further described above inrelation to FIG. 5.

Train button 1330 can also be used to provide a setup signal used to setreference point 1310. When train button 1330 is pressed with exampleobject 1302 in FOV 1312, one or more images are captured and used alongwith a model by a normalized correlation process to find example object1302. Reference point 1310 is set to the position found.

Note that train button 1330 can be used to initiate the trainingprocess, to provide a setup signal for setting a reference point, or toaccomplish both with a single press of the button.

FIG. 14 shows test object 1400 in three test positions relative to FOV1412 and reference point 1410: first test position 1450, where testobject 1400 is at a negative position relative to reference point 1410within FOV 1412; second test position 1452 where test object 1400 is ata positive position relative to reference point 1410 within FOV 1412;and third test position 1454, where test object 1400 is so far away fromreference point 1410 that it is no longer be found in FOV 1412.

An HMI comparable to HMI 1320 of FIG. 13 is shown in three statescorresponding to the three test positions: first HMI 1424 corresponds tofirst test position 1450; second HMI 1434 corresponds to second testposition 1452; and third HMI 1444 corresponds to third test position1454. Note that first HMI 1424, second HMI 1434, and third HMI 1444represent the same HMI in three different states.

Similarly, first negative position indicator 1420, second negativeposition indicator 1430, and third negative position indicator 1440represent the same indicator in three different test positions, andfirst positive position indicator 1422, second positive positionindicator 1432, and third positive position indicator 1442 represent thesame indicator in three different test positions.

When test object 1400 is at first test position 1450, first negativeposition indicator 1420 is on and first positive position indicator 1422is off, indicating that test object 1400 is found in FOV 1412 in anegative position relative to reference point 1410.

When test object 1400 is at second test position 1452, second negativeposition indicator 1430 is off and second positive position indicator1432 is on, indicating that test object 1400 is found in FOV 1412 in apositive position relative to reference point 1410.

When test object 1400 is at third test position 1454, third negativeposition indicator 1440 and third positive position indicator 1442 areboth off, indicating that test object 1400 cannot be found in FOV 1412.

By using test objects similar to test object 1400, and indicators asshown and described, an installation technician or other user of alinear detector can verify that a suitable model is in use, and that thereference point is as desired. The indicators should show that a testobject is found when one sufficiently similar in appearance to the modelin use in placed in the FOV, and should show that nothing is found whenno such object is present.

FIG. 15 shows HMI 1520 used to establish positive direction of motion1512 and place the linear detector into a running state. Run button 1550is pressed to cycle among three states: training mode, with negativedirection indicator 1542 and positive direction indicator 1540 both off;running with positive direction of motion, with negative directionindicator 1542 off and positive direction indicator 1540 on, as shown inthe figure; and running with negative direction of motion, with negativedirection indicator 1542 on and positive direction indicator 1540 off.In an illustrative embodiment, the training process is inhibited whenthe linear detector is in one of the two running states.

In FIG. 15, object 1500 is in FOV 1514, upstream of reference point1510, which corresponds to a negative position since direction of motion1512 is positive. Negative position indicator 1530 is on, and positiveposition indicator 1532 is off, indicating the object 1500 is found at anegative position within FOV 1514.

The forgoing discussion of an HMI pertains to specific embodiments andit is contemplated that significant modifications or entirely differentmethods and processes that occur to one skilled in the art can be usedto achieve similar effects, or other desired effects in accordance withthe teachings described herein. The HMI could make use of a personalcomputer instead of or in addition to buttons and indicators. The HMIcould use alphanumeric indicators instead of simple lights, and couldallow setting of any parameter used by an embodiment of the invention.

The foregoing has been a detailed description of various embodiments ofthe invention. It is expressly contemplated that a wide range ofmodifications, omissions, and additions in form and detail can be madehereto without departing from the spirit and scope of this invention.For example, the processors and computing devices herein are exemplaryand a variety of processors and computers, both standalone anddistributed can be employed to perform computations herein. Likewise,the linear array sensor described herein is exemplary and improved ordiffering components can be employed within the teachings of thisinvention. Also, some, or all, of the capture process, measurementprocess, decision process, and optional signaling process can becombined or parsed differently. Numerical constants used herein pertainto illustrative embodiments; any other suitable values or methods forcarrying out the desired operations can be used within the scope of theinvention. Accordingly, this description is meant to be taken only byway of example, and not to otherwise limit the scope of this invention.

1.-68. (canceled)
 69. A computer program product for optically providinginformation describing an object in motion relative to a one-dimensionalfield of view, such that the object passes through the field of view,the product tangibly embodied in a non-transitory computer readablemedium, the computer program product comprising instructions beingoperable to cause a data processing apparatus to: receive datarepresenting a plurality of images of the one-dimensional field of view,wherein the images are oriented approximately parallel to the directionof motion; and at least a portion of the images correspond to aplurality of positions of the object relative to the field of view; andcalculate information describing the object based on at least a portionof the images.
 70. The product of claim Error! Reference source notfound., wherein the information describing the object comprisesknowledge responsive to object presence in the field of view.
 71. Theproduct of claim Error! Reference source not found., wherein the objectcrosses a reference point at a reference time and the informationdescribing the object comprises an estimate of the reference time. 72.The product of claim 70, wherein the estimate of the reference time isdetermined by predicting the reference time.
 73. The product of claim70, wherein the product further comprises instructions to cause the dataprocessing device to provide a value responsive to the estimate of thereference time for consumption by an input/output module.
 74. A systemusing the product recited in claim 71, further comprising a signalingprocess that produces a signal that indicates the estimate of thereference time by occurring at a signal time that is responsive to theestimate of the reference time.
 75. The system of claim 74, furthercomprising an electronic human-machine interface, and wherein the signaltime is adjusted in response to the human-machine interface.
 76. Thesystem of claim 74, wherein there is no latency between the referencetime and the signal time.
 77. A system using the product recited inclaim 71, further comprising an example object; and a setup signal thatindicates that the example object is placed in the field of view at asetup position; and wherein the reference point is set responsive to theexample object, the setup signal, and the setup position.
 78. The systemof claim 77, further comprising a signaling process that produces asignal responsive to the information describing the object, wherein thesignal occurs at a time when the object crosses the setup position. 79.The system of claim 77, further comprising a signaling process thatproduces a signal responsive to the information describing the object,and wherein the signal occurs at a time when the object is upstream fromthe setup position.
 80. A system using the product recited in claim 71,further comprising a test object; and a human-machine interfacecomprising an indicator that indicates a detection state that includesat least one of: the test object is detected upstream from the referencepoint; the test object is detected downstream from the reference point;and the test object is not detected.
 81. A system using the productrecited in claim 71, further comprising a linear optical sensor having aone-dimensional array of photoreceptors that makes light measurements inthe field of view.
 82. The product of claim 70, wherein the productfurther comprises instructions to cause the data processing device tocalculate the information describing the object further comprises:calculating image measurements based on at least a portion of theimages; selecting as object measurements, ones of the image measurementscalculated responsive to the object; and calculating the informationdescribing the object based on the object measurements.
 83. The productof claim 82, wherein at least a portion of the image measurements areresponsive to object presence in the field of view and the informationdescribing the object comprises knowledge responsive to object presencein the field of view.
 84. The product of claim 82, wherein the objectcrosses a reference point at a reference time; at least a portion of theimage measurements are responsive to object position in the field ofview; and wherein the product further comprises instructions to causethe data processing device to select the object measurement, ones of theimage measurements that are responsive to object position and calculatean estimate of the reference time based on the object position as theinformation describing the object.
 85. The product of claim 84, whereinthe capture process produces a plurality of capture times, each capturetime being responsive to a time at which a corresponding image wascaptured; and the decision process is responsive to at least one of thecapture times.
 86. The product of claim 85, wherein the decision processcomprises fitting a curve to points comprising at least a portion of thecapture times and corresponding object measurements that are selectedfrom among the image measurements that are responsive to object positionin the field of view
 87. The product of claim 84, further comprising anelectronic human-machine interface, and wherein the reference point isadjusted in response to the human-machine interface.
 88. The product ofclaim 84, further comprising a signaling process that produces a signalresponsive to the information describing the object, and wherein thesignal indicates the information describing the object by occurring at asignal time that is responsive to the estimate of the reference time.89. The product of claim 88, further comprising an electronichuman-machine interface, and wherein the signal time is adjusted inresponse to the human-machine interface.
 90. The product of claim 88,wherein there is no latency between the reference time and the signaltime.
 91. The product of claim 84, wherein the decision processdetermines the estimate of the reference time by predicting thereference time.